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1.  INTRODUCTION 

Both  Picard's  and  Newton's  methods  have  been  the  subject  of  recent 
investigations  by  Schroder,  Kalaba,  Collatz  et  al. 

The  results  obtained  seem  to  hold  some  promise  for  the  iterative 
solution  of  the  Euler  -  Lagrange  boundary  value  problem  in  variational  problems. 

The  present  outline  surveys,  in  moderate  generality,  three  methods 
making  use  of  the  concept  of  partial  order; 

1)  An  extension  of  Picard's  method  in  which  Lipschitz  constants 
become  operators  and  the  concept  of  contraction  is  generalized. 

2)  An  extension  of  Picard's  method  using  monotone  properties  and 
the  Schauder  fixpoint  theorem,  dispensing  with  Lipschitz  con¬ 
ditions  entirely. 

3)  An  extension  of  Newton's  method  using  convexity,  resulting  in 
maximum -minimum  principles  and  dispensing  with  second 
derivatives . 


2.  SPACES 


2 .  1  P-Spaces 

A  real  Banach  space  7 T  will  be  called  a  P-space  if  a  relation  <  is 
defined  between  some  pairs  of  points  and  has  the  following  properties  for 
all  x,  y,  z,  u,  v  in  7T  .  £  >  denotes  the  converse  of  relation  < 


X  <  X 

(i) 

X  <  y,  y  <  z  =>  x  <  z 

(2) 

x  <■  y,  y  <  x  =>  x  =  y 

(3) 

x  >  O  =£>  c  x  >  O  for  c  real  positive 

TT  TT  * 

(4) 

x  >  y,  u  >  v  =$>  x  +  u  >  y  +  v 

(5) 

<  X  <  y  =>||x||  <  1 1  y  1 1 

(6) 

lim  x  =  x,  x  >  O  =>  x  >  O 

n  n  tt  tt 

n— oo 

(7) 
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Positive  cone;  These  conditions  amount  to  saying  that  C  =  {x  :  x  >  } 

is  a  closed  convex  cone  in  77  which  remains  convex  when  O-^  is  removed 
and  such  that  for  all  x  in  ir 


(y  :  1 1  y  1 1  <  1 1  x  I !  }  fl  {x  +  z  :  z  e  C}  =  <J>  (the  empty  set)  (8) 

then 

x  <■  y  <--■>  y  -  xe  C 

Intervals:  [x,  yj  —  {z  :  x  <  z  <  y}  is  called  the  interval  between  x  and  y. 
Then 

[x,y]  is  closed,  convex  and  bounded  (9) 

x  <■  y  <=>[x,  y]  /  <t>  (10) 

[x,y]=  {x  +  z;zeC}  f|  {y  -  u  :  u  e  C}  (11) 

2 . 2  Q-Spaces 

A  real  vector  space  S  will  be  called  a  Q-space  if  there  are,  associated 

to  S 

a)  a  P  space  77 

b)  a  function  N,  called  partial  norm,  mapping  S  into  77  and  such  that, 
for  x,  y  e  S  the  following  four  conditions  be  satisfied: 


N(x)  =  O  <=>  X  =  Ct;  (12) 

N(cx)  =  |c  |  N(x)  for  all  real  c  (13) 

N(x  +  y)  <  N(x)  +  N(y)  (14) 

Let  a  norm  in  S  be  defined  by 

IMIg*  1 1  N(x)|  |  n  (15) 


then  S  is  a  Banach  space  under  this  norm.  Comment:  then  N  is  a  continuous 
mapping  of  S  into  the  positive  cone  C  of  77  . 

Examples  of  P-spaces: 

a)  PRn  space  of  vectors  x  =  (§^,  .  .  .  ,  c^)  with  some  norm. 

(?1»  •  •  . »  £n)  «  (ni»  •  •  •  »  nn)  is  defined  by 
§•  <  Hi  i  =  1,  .  .  .  ,  n  (16) 
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b)  PCn[0,  lj  space  of  continuous  functions  f  from  0,  1  into  PRn, 
with  norm 

1 1  f  II  =  max  ||  f(t)  1 1  . 

°<t<l 

f  <  g  defined  by 


f(t)  <  g(t)  in  PRn  0  <  t  <  1 

(17) 

Examples  of  Q-spaces: 

c)  QRn  space  of  vectors  x  =  ( £  ^  ,  .  .  .  ,  £  )  Associated  P- 
Partial  norm: 

space : 

PRn 

N(x)  =  (|§j| . lsn|) 

(18) 

d)  QCn[  0,  lj  space  of  continuous  functions  from  [  0,  1  j 
f  =  (f  j(t),  .  .  .  ,  ^n(t))  Associated  P-space;  PCn  0,  1  j 

into  Rn 

Partial 

norm : 

N(f)  =  ( |  £x(t)  | . |fn(t)|) 

(19) 

e)  QCn^[0,  lj  as  in  (d) 

Associated  P-space:  PC^O,  lj  Partial  norm 


N(f)  =  ||f(t)||  in  Rn  a  function  of  t  (20) 

f)  QCnRn[0,  lj  as  in  (d)  Associated  P-space:  PRr‘  Partial  norm: 
the  vector 

N(f)  =  (  max  |f.(t)| .  max  |f  (t)|  )  (21) 

0<t<l  o<t<i 

g)  any  real  Banach  space  with  77  as  the  real  line  and  N  as  the  norm. 
Comment:  The  structure  of  77  can  be  as  rich  as  that  of  S  but  may  go  down 
as  far  as  R  . 


3.  FUNCTIONS 


3 .  1  Functions  from  a  P-space  into  a  P-space 
domain  D  c  77 


1 


77*1 ,  77^  P-spaces 


function  T  :  D 


77 


Since  P-spaces  are  Banach,  the  concepts  of  linearity,  continuity,  complete 
continuity  and  (Frechet-)  differentiability  are  defined  ipso-facto. 
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Other  concepts  are: 


Positivity:  x  >  O  => 

Tx  >  O 

TZ 

(22) 

Isotony:  x  >  y  =>Tx 

»  Ty 

Vx,  y  e  D 

(23) 

Antitony:  x  >  y  =>  Tx 

<  Ty 

(24) 

Monotony:  Tx  >  Ty=>  x 

>  y 

(25) 

For  linear  T  positivity  and  isotony  are  equivalent. 

The  usual  definition  of  a  convex  function  requires  that  the  domain  D 
be  convex  and  that  the  range  space  7T^  be  the  set  of  real  numbers.  To 
relax  the  second  requirement  define 
Convexity:  T  is  convex  if 

a)  D  is  convex 

b)  T  has  a  Frechet  derivative  at  every  point  of  D. 

Let  T,'  .  denote  the  Frechet  derivative  at  y.  a  linear  function  from  7T.  into 

(y)  7  i 


7T2. 


c)  for  all  x,  y  in  D 


Tjy)  (x  -  y)  <  Tx  -  Ty 


(26) 


Extr emization:  For  a  function  F  from  an  arbitrary  set  A  into  a  P-space, 
define 


and 


* 


m  =  p  m  ax  Fa  <=>  3be  A,  V  a  ^  A :  Fa  <  Fb  =  m 
ae  A 


(27) 


pmin  Fa  =  -  pm  ax  { -  Fa) 
a  £  A  a  e  A 


Then  (26)  can  be  written 

Tx  =  p max  (Ty  +  T’  (x  -  y))  (28) 

y  6  D  'y; 

the  maximum  being  attained  for  x  =  y. 


3 .  2  Functions  from  Q-spaces  into  Q-spaces 

Let  T  be  a  function  mapping  a  domain  D  of  a  Q-space  (with  partial  norm 
Nj  taking  its  values  in  P-space  IT ^ )  into  a  Q-space  (with  partial  norm 


*  Note  that  if  a  pmax  exists  its  value  m  is  unique,  just  as  in  the  real  case. 
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taking  its  values  in  P-space  7 T^). 

Since  and  are  Banach  spaces  under  the  induced  norms 


IlNjxll  1 1  y 

continuity  and  F 


rechet 


n7y! 


i 


the  concepts  of  linearity,  continuity,  complete 


differentiability  are  defined. 


Generalized  Lipschitz  Condition 

The  function  T  is  said  to  be  Lipschitz  continuous -K  on  D  iff  there  exists 
a  continuous  linear  positive  function  K  :  7T  —  7T0  such  that  for  all  x,  y  in  D 

N2(Ty  -  Tx)  <  KN}(y  -  x)  (29) 

This  implies 

II  Ty  -  Tx||  <  ||K||  •  1 1  y  -  x||  (30) 

b2  bl 

so  that  T  is  then  Lipschitz  continuous  with  the  constant  ||K  1  also. 
Generalized  Contraction: 

A  function  T  mapping  a  domain  D  of  a  Q-space  S  into  the  same  space  S 
is  a  K-contr action  on  D  if  it  is  Lipschitz  continuous  K  on  D  and  the  linear 
function  K  on  the  associated  P-space  7 T  satisfies  the  condition 

2 

x  +  Kx  +  K  x  +  .  .  .  converges  for  all  x  in  7T  (31) 

It  is  sufficient  to  this  effect  that  ||K||  <  1,  then  T  is  a  contraction  in  the 
ordinary  sense  under  !  •  |  |  It  is  also  sufficient  (and  necessary)  that  the 
spectral  radius  of  the  linear  operator  K  satisfy 

p(K)  <  1  (32) 


4.  THE  GENERALIZED  PICARD  ITERATION 

Problem:  Let  T  be  a  function  mapping  a  domain  D  of  a  Q-space  S  (with  partial 
norm  N  taking  its  values  in  P-space  IT  )  into  S.  Find  an  element  x  of  D  for 
which  x  =  Tx  (a  fixpoint). 

Contraction  Theorem: 

Let  T  be  a  K-contraction  on  D 

Let  Xq  be  an  element  of  D 

Let  x^  =  TXq  and  r^  =  N(x^  -  x^) 
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Then  the  equation 


r  -  Kr  =  Kr Q  (33) 

has  a  unique  solution  r*  in  7T  . 

If  furthermore 

{x  :  N(x  -  x  )  <  r*}  C  D  (34) 


then  the  sequence  obtained  by 

xn+1  =  Txn  n=  0,1,2,...  (35) 

(a)  exists  in  D 

(b)  converges  to  a  limit  x*  in  D 

(c)  x*  is  the  unique  solution  of  x  =  Tx  in  D 

(d)  an  error  estimate  is  given  by 

n(x*  -  Xj)  <•  r*  (36) 


Application:  If  the  iteration  has  been  carried  out  up  to  the  calculation  of  x  , 

n 

apply  the  theorem  with  x  .  as  x~  and  x  as  x.  . 

1  n- 1  0  n  1 

Equation  (33)  need  not  be  solved,  it  is  sufficient  to  find  b  in  IT  such 
that  r*  <•  b  and  use  b  in  (36).  The  bound  b  can  be  found  from  the  condition 


b  -  Kb  >  Kr, 


(37) 


For  instance  if  c  »  0  and  a,  p  real  satisfy 


then 


Kc  <•  pc 

r*  <■ 


r0  <  ac 


P  <  1 


1  -  p 


Kc  < 


aP 

1  -  p 


(38) 


5.  THE  MONOTONE  PICARD  ITERATION 

Problem:  LetT  be  a  function  from  a  convex  domain  D  in  a  P-space  77"  into 
7 T.  Assume  T  =  Tj  +  T^  with  T^  isotone  on  D,  T^  antitone  on  D.  Find  a 
fixpoint  x  =  Tx  of  T  in  D. 

Method:  Start  from  2  elements  x^,  of  D  and  proceed  by 

x  =  T.  x  +  T,  y 
n+ 1  In  2  1  n 

(39) 

y.=T.y  +T_x 
7  n+  1  1  7  n  2  n 
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(40) 


Nesting  Theorem: 

If  [xo>yo]  c  D  and  xo*  X1  <  yi  *  yo 

then  (a)  x^  <-  x  <  <  .  .  .  ^  ^  Y ]  ^  Y()  e-  »  iteration  defines 

a  sequence  of  nested  non-empty  intervals  [xn»  Yn 
(b)  The  image  of  [xn>Yn]  under  T  is  a  subset  of  [x  ^,y  j]  an(3  a 

fortiori  of  itself.  Thus  any  fixpoint  in  [xg»yg  belongs  to  [xn*Yn] 
for  all  n. 

Fixpoint  Theorems: 

A.  Finite  dimensional  case. 

If  IT  is  finite  dimensional  then  (39),  (40)  imply 

(a)  x  — ►  x*  and  y  — ►  yr*  with  x*  <-  y* 

\  /  n  7  n  7  7 

(b)  if  T^  and  T^  are  continuous  then  there  exists  a  fixpoint 
in  [x*,  y*]  and  a  fortiori  in  [xn»  y  ]  . 

(c)  if  Tp  T^  are  linear  then  -^-(x*  +  y*)  is  a  fixpoint. 

B.  Infinite  dimensional  case. 

(a)  If  the  image  of  lxr»  Yn\  under  T  is  totally  bounded  it  con- 
contains  a  fixpoint  of  T. 

(b)  If  T  is  completely  continuous  on  Lxn’ Yn  t^ien  statement 
(a)  applies  . 

Since  intervals  are  closed,  bounded  and  convex  these  proper¬ 
ties  result  essentially  from  the  Schauder  fixpoint  theorem. 

Application:  Solutions  of  differential  equations  can  often  be  considered  as 
fixpoints  of  completely  continuous  integral  transformations. 

Note  that  no  Lripschitz  constant  or  operator  K  need  be  determined. 


6.  THE  MONOTONE  NEWTON  ITERATION 


Problem:  Let  S  and  S^  be  P-spaces  and  V  a  real  vector  space.  Let  L  be 
a  linear  and  F  a  non-linear  function  from  a  domain  D  in  S  into  S^  and  G  a 
linear  function  from  D  into  V.  Let  c  be  a  given  element  of  V.  Find  x  in  D 
such  that 


Lx  =  Fx 
Gx  =  c 


(41) 
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Assumptions  : 

a)  D  is  convex 

b)  there  exists  a  linear  function  R  from  S  ^  to  S  such  that  "  Rl|  <  7 
and  RLx  =  x  for  x e  D  {y  :  Gy  =  c} 

c)  F  has  a  bounded  Freshet  derivative  on  D 

II  F(x)l!  - 11  for  x  e  D 


d) 

F  is  convex  on  D 

e) 

l|Fx|| 

<  a  +  (3  1 1  x 

f) 

t(P  +  2 

n)  <  1 

g) 

I  = 

(x  :  1 1  X 1 1  • 

h) 

Lx0  * 

Fx0 

i)  Gxq  =  c 

j)  Lx  >  F|^)X  and  Gx  =  Oy  =>  x  >  Og 

k)  For  all  x  c  D  there  exists  a  unique  solution  y  of  the  linear  equations 


Ly  =  Fx  +  F'x)(y  -  x) 
Gy  =  c 


(42) 


This  defines  a  function  T  from  D  into  S  by  y  =  Tx. 

l)  (41)  has  a  solution  x*  in  D. 

m)  Xq  and  x^  =  Tx^  are  in  D. 

Newton's  Method: 

Under  assumptions  (c)  and  (k)  starting  from  an  element  x^  in  D  attempt 
the  iteration 

x  =  Tx 
n+ 1  n 

which  is  possible  as  long  as  the  iterates  stay  in  D. 

Monotone  Property: 

Under  assumptions  (a)  (c)  (d)  (j)  (k) 

x  .  ,  x  for  n  >  1 

n+1  ^  n  — 


Maximum  Principle: 

Under  assumptions  (a)  (c)  (d)  (j)  (k)  (1)  (m) 


x*  =  pmax  T  x 
x  e  D 


(43) 


(44) 


Interval  Property: 

Under  assumptions  (a)  (c)  (d)  (h)  (j)  (k)  (1)  (m) 


<r  X* 


Minimum  Principle: 

Under  assumptions  (a)  (c)  (d)  (j)  (k)  (1)  (m) 
x*  =  pmin  Xq 

(45) 

subject  to  Xq  e  D  and  Lx^  >  Fx^ 


Boundedness  Property 

Under  assumptions  (a)  (b)  (c)  (d)  (e)  (f)  (g)  (j)  (k)  and  x^>  the 
sequence  x^,x^,x^  exists,  is  monotone  increasing  and  contained  in  £ 

In  finite  dimension  this  implies  convergence  to  a  solution  of  the  problem. 
In  infinite  dimension  convergence  follows  only  if  the  sequence  can 
be  shown  to  be  sequentially  compact  (as  when  T  is  completely  continuous). 
Otherwise,  for  instance  in  PC  [0,  1]  only  pointwise  convergence  follows. 


7.  BOUNDARY  VALUE  PROBLEMS 


x  =  A(t)x  +  F(x,  t)  F,  c,  x  n-vectors 

Nx(0)  +  Mx(  1 )  =  c  A(t),  N,  M  nbyn  matrices 

Let  <$(t)  be  a  fundamental  matrix,  a  non-singular  solution  of 
$(t)  =  A(t)  $(t) 

Assume  N$(0)  +  M$(l)  is  non- singular .  Then  the  solution  of 
x  =  A(t)  x  +  f(t) 

Nx(0)  +  Mx(l)  =  c 


(46) 


(47) 


is  for  0  <  t  <  1 


x(t)  =  G  ^(t)  c  + 


1 

J  G(t,  t)  f ( t )  dT 
0 


where 


(48) 
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Gj(t)  =  *(t)[N#(0)  +  M$(l)] 


G(t,  t) 


G^(t)  Nf(0)  $  *(t)  for  t  <  t 

-Gj(t)  Mf(l)  $  *(t)  for  t  >  t 


(49) 


(the  value  for  t  =  t  is  immaterial) 

The  solution  of  the  non-linear  problem,  if  one  exists,  is  a  continuous  func¬ 
tion  x(t)  satisfying 

1 

x(t)  =  Gj(t)  c  +  J  G(t,  t)  F(x(t),  t)  dT  (50) 

0 


i.e.  ,  it  is  a  fixpoint  x  =  Tx  of  the  mapping  T  from  the  space  of  continuous 
Rn-valued  functions  on  [0,  1]  into  itself  defined  by  (50). 

Taking  any  norm  in  Rn  and  the  maximum  over  0  <  t  <  1  of  this  norm 
as  the  function  space  norm  the  function  T  is  completely  continuous  in  many 
cases. 

Thus  the  iterative  methods  can  often  be  applied. 

Example :  (Collatz) 

x  —  - 1  -  v/x~  x(0)  =  0  x(l)  =  1 

There  is  no  Lipschitz  constant  for  this  problem  but  the  iteration, 


W°>  =  0 

xn+l(1)  '  1 

n+1  =  -*  - 

w°> = 0 

W‘>' 1 

is  isotone  with 


x(t)  <•  y(t)  <=>x(t)  <  y(t)  V  te  [0,  1] 


and  is  completely  continuous 

^  t  .  2  4  3/3 

Taking  xQ  =  t  Xj  =  -j  t  -  t  ' 

y0  =  (2  yr  -  t)2  yx  =  41  t  - 

Then  x^  <•  x^  «  y^  <  y^  and  x^(t)  <  x*(t)  <  y^(t)  V 


8  5/2 

IT 

t£[0,l] 


for  a  solution  x*. 
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